Solving Rank-Deficient Linear Least-Squares Problems*
نویسندگان
چکیده
Numerical solution of linear least-squares problems is a key computational task in science and engineering. Effective algorithms have been developed for the linear least-squares problems in which the underlying matrices have full rank and are well-conditioned. However, there are few efficient and robust approaches to solving the linear least-squares problems in which the underlying matrices are rank-deficient and sparse. In this paper, we propose a new method for solving rank-deficient linear least-squares problems. Our proposed method is mathematically equivalent to an existing method but has several practical advantages over the existing method. Furthermore, our proposed method is applicable to solving both dense and sparse rankdeficient linear least-squares problems. Our experimental results demonstrate the practical potential of our proposed method.
منابع مشابه
Algorithm xxx: an Efficient Algorithm for Solving Rank-Deficient Least Squares Problems
Existing routines, such as xGELSY or xGELSD in LAPACK, for solving rank-deficient least squares problems require O(mn) operations to solve min ‖b−Ax‖ where A is an m by n matrix. We present a modification of the LAPACK routine xGELSY that requires O(mnk) operations where k is the effective numerical rank of the matrix A. For low rank matrices the modification is an order of magnitude faster tha...
متن کاملFast solving of weighted pairing least-squares systems
This paper presents a generalization of the "weighted least-squares" (WLS), named "weighted pairing least-squares" (WPLS), which uses a rectangular weight matrix and is suitable for data alignment problems. Two fast solving methods, suitable for solving full rank systems as well as rank deficient systems, are studied. Computational experiments clearly show that the best method, in terms of spee...
متن کاملGauss-Seidel Iterative Methods for Rank Deficient Least Squares Problems
We study the semiconvergence of Gauss-Seidel iterative methods for the least squares solution of minimal norm of rank deficient linear systems of equations. Necessary and sufficient conditions for the semiconvergence of the Gauss-Seidel iterative method are given. We also show that if the linear system of equations is consistent, then the proposed methods with a zero vector as an initial guess ...
متن کاملRank-deficient and Ill-conditioned Nonlinear Least Squares Problems
In this paper we review classical results by Ben-Israel, Boggs, and Tanabe on algorithms for rank-deficient nonlinear least squares problems and compare them to our recent perturbation theory results for such problems. Using a simple example, we show how sufficiently large perturbations can lead to poor convergence or even incorrect results, and how the application of subset selection can solve...
متن کاملApproximate Generalized Inverse Preconditioning Methods for Least Squares Problems
iv erative methods to solve least squares problems more efficiently. We especially focused on one kind of preconditioners, in which preconditioners are the approximate generalized inverses of the coefficient matrices of the least squares problems. We proposed two different approaches for how to construct the approximate generalized inverses of the coefficient matrices: one is based on the Minim...
متن کامل